# Ukrainian language optimization

Llama-2-7b-Ukrainian Version is a bilingual pre-trained model supporting Ukrainian and English, based on continued pre-training of Llama-2-7b using 5 billion tokens of data from CulturaX.

A sentence embedding model optimized for Ukrainian, based on the multilingual MPNet architecture, suitable for semantic similarity and feature extraction tasks

An open-source large language model optimized for Ukrainian, built through a three-stage training process including fine-tuning, model merging, and direct preference optimization

A 1.3 billion parameter language model optimized for Ukrainian, deeply fine-tuned based on mGPT-XL(1.3B)